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IV&V project assessment 
Process Validation Presentation 


• Presenters 

- Stephen Driskell 

- Team Members for Questions 

Study support from 

• Rich Wolf, HEO ESD IV&V Deputy Project Manager 

• Christina Moats, HEO ESD IV&V Project Manger 
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NASA IV&V SLS Topic & Participants 

• Abstract : The Space Launch System will launch NASA's Multi-Purpose Crew 
Vehicle 1PCV) This launch vehicle will provide American launch capability for 
human exploration and travelling beyond Earth orbit. SLS is designed to be flexible 
for crew or cargo missions. The first test flight is scheduled for December 201 . 

The SLS SRR/SDR provided insight into the project development life cycle. NASA 
IV&V ran the standard Risk Based Assessment and Portfolio Based Risk Assessment 
to identify analysis tasking for the SLS program. This presentation examines the SLS 
System Requirements Review/ System Definition Review (SRR/SDR), IV&V findings 
for IV&V process validation correlation to / from the selected IV&V tasking and 
capabilities. It also provides a reusable IEEE 1012 scorecard for programmatic 
completeness across the software development life cycle. 

• Two teams performed separate concurrent assessments 

- IV&V Participants in the SLS SRR/SDR 

• Melvin Rother, Bimal Patel, Vaughn Harvey, Stephen Driskell, Thomas Marshall, Gary Barber, James 
Chamberlain, and Noble Nkwocha, 

- IV&V Participants in the RBA and PBRA 

• Van Casdorph, John Bradbury, Rodger Barrington, David Frazier, James Dell, Richard Wolf, and Kimberly 
Mittelsted, 
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SLS Missions Summary 



Exploration 
Missions For 
Earth and Moon 
to 

Asteroids 

Mars 

& Mars Moons 


Initial Capability 
70 mt in 2017 
to 

Evolved 
Capability 
130 mt 
Cargo 
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SRR/SDR IV&V results 

• IV&V team submitted 33 Pre-RIDs, of which 7 became stand-alone RIDs and 4 were 
combined into other RIDs. All of the information submitted by the IV&V team 
(whether on a RID or not) was provided to the SLS personnel in that area to be 
incorporated into the program 

• All of these Pre-RIDS and RIDS fall into one of three categories: 

• IV&V issues Accepted as RIDS 7 

• SLS Program Combined IV&V comments with other reviewers RIDS 4 

• SLS Program comments to documents and "future work" 22 

IV&V project assessment validation results 

• PBRA - there is a GOOD correlation from SRR/SDR IV&V RIDS and Pre-RIDS 
to the Portfolio Based Risk Assessment 

• RBA - there is a GOOD correlation from SRR/SDR IV&V RIDS and Pre-RIDS 
to the Risk Based Assessment 

• IEEE 1012 - there is a GOOD correlation from SRR/SDR IV&V RIDs and Pre- 
RIDs to the SRR/SDR Software Life Cycle to the IEEE 1012 Software 
Validation and Verification Standard - 2004 
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SLS Affordability Tenets & Options 


Boosters, Stages, Engines, Spacecraft & Fairings, 
Advanced Development + Existing Capabilities 
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ID 


SLS1 


SLS2 


SLS3 


SLS4 


SLS5 


SLS8 


SLS9 


SLS 13 


SLS16 


PBRA Map to IV&V SRR/SDR Results 


SLS10 


SLS11 


SLS12 


SLS17 


SLS18 


SLS19 


SLS20 


SLS21 

Total 


RIDs 

only 


11 


Pre- 

RIDs 


33 




Capability 


SLS. Provide Health & Status data 


SLS. Provide Caution & Warning data 


SLS. Provide Fault Detection 


SLS. Provide Fault Isolation 


SLS. Provide Fault Recovery 


SLS. Perform Vehicle State & Mode Management 


SLS. Perform GNC 


-n 


SLS. Manage Subsystem Power 


SLS. Manage Flight Termination System 


SLS. Perform Required Abort Sequence 


SLS. Control Boosters 


SLS. Control RS-25 Engines 


SLS. Control iCPS Engine 


SLS. Control CPS Engine 


SLS. Control J-2X Engines 


SLS.Track Ascent Operations 


SLS. Provide CMP Validation & Acceptance 


SLS. Provide onboard command history 


SLS. Provide Data to Ground 


SLS. Provide Data to MPCV 


SLS. Provide stage break-up and sinking upon impact 



• 
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RBA To IV&V SRR/SDR 


SLSRBA 5x5 Results 


16 


13 



11 




15 


10 


19 


14 


6 7 20 

21 22 11 

2 13 24 

B S 

9 23 

15 16 


3 4 5 

Impact 



13 


14 


15 


16 


17 


18 



Entity 

|Guidance, Navigation & Control 

Thrust Vector Control 

|Real Time Operating System 

Hardware I/O 

M&FM - Mission Manager 

M&FM - Abort Manager 

|M&FM - Flight Computer Redundancy Manager 

Special Test Application Software 

CTC ApplicationSoftware 

Development Flight Instrumentation 

|Redundant Inertial Navigation Unit 

Camera Controller Unit /Imaging System 

Core Stage Power Distribution & Control Unit 

Data Acquisition Control Unit 

Core Stage Engine Control Unit 

Rate Gyro Assembly 

Flight Safety System 

Data Acquisition & Recording Unit 

Engine Data Acquisition Unit 

Idolilu 

plight Design 

|Mission Execution & Flight Ops 

Upper Stage Engine Control Unit 

1553 I/O 


N - Not evaluated in SRR/SDR 
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IEEE 1012-2004 Standard for Software 
Verification and Validation 

SLS 

Artif 

act 

#1 

SLS 

Artif 

act 

#2 

SLS 

Artif 

act 

#3 

IV&V 

Pre- 

Rid 

& 

RID 

References 


1 . Overview 







2. Referenced documents 







3. Definitions 







4. Software integrity levels 







5. Software V&V processes 







5.1 Process: Management 







5.1.1 Activity: Management of V&V 







5.2 Process: Acguisition 







5.2.1 Activity: Acguisition support V&V 







5.3 Process: Supply 







5.3.1 Activity: Planning V&V 




1 

V&V plan, testing & risk criteria not defined 


5.4 Process: Development 




1 

SDR/SRR artifact maturity 


5.4.1 Activity: Concept V&V 




1 

CONOPS - Engines & Stages 1 001 


5.4.2 Activity: Reguirements V&V 




26 

Reguirements 


5.4.3 Activity: Design V&V 




1 

upper stage sensor missing 


5.4.4 Activity: Implementation V&V 







5.4.5 Activity: Test V&V 




1 

Vehicle Management Spec: missing verification, 
clarify role 


5.4.6 Act: Installation and checkout V&V 







5.5 Process: Operation 







5.5.1 Activity: Operation V&V 







5.6 Process: Maintenance 







5.6.1 Activity: Maintenance V&V 







6. Software reporting reguirements 







6.1 V&V reports 







6.2 V&V administrative reguirements 







6.3 Documentation reguirements 




1 

Architecture 


7. Software V&V plan outline 




1 

Verification Activities 


Annex A Mapping tables 







Annex B risk based integrity level scheme 







Annex C IV&V types 







Annex D V&V of reuse SW 







Annex E V&V measures 







Annex F Organizational relationship 







Annex G Optional V&V tasks 







Algorithm analysis. 







Regression analysis and testing. 







Reuse analysis. 







Simulation analysis. 







Sizing and timing analysis. 







Total 




33 
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IV&V SLS Results MAP to 
IEEE 1012-2004 

• SRR/SDR IV&V findings 

• Mostly Requirements 

• Some Findings on 

— Architecture 
— Verification 
- CONOPS 




SRR/SDR IV&V results 

• IV&V team submitted 33 Pre-RIDs, of which 7 became stand-alone RIDs and 4 were 
combined into other RIDs. All of the information submitted by the IV&V team 
(whether on a RID or not) were provided to the SLS personnel in that area to be 
incorporated into the program 

• All of these Pre-RIDS and RIDS fall into one of three categories: 

• IV&V issues Accepted as RIDS 7 

• SLS Program Combined IV&V comments with other reviewers RIDS 4 

• SLS Program comments to documents and "future work" 22 

IV&V project assessment validation results 

• PBRA - there is a GOOD correlation from SRR/SDR IV&V RIDS and Pre-RIDS 
to the Portfolio Based Risk Assessment 

• RBA - there is a GOOD correlation from SRR/SDR IV&V RIDS and Pre-RIDS 
to the Risk Based Assessment 

• IEEE 1012 - there is a GOOD correlation from SRR/SDR IV&V RIDs and Pre- 
RIDs to the SRR/SDR Software Life Cycle to the IEEE 1012 Software 
Validation and Verification Standard - 2004 
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WRAP UP 

* NASA IV&V Process for RBA and PBRA supports the capabilities for 
selecting analysis targets to support SMA and national objectives for the 

SLS Innovative New Business Model 

* Based on the SRR/SDR Findings IV&V will 

revisit the PBRA/RBA rationale for 

- Perform Required Abort Sequence 

- Track Ascent Operations 

- Flight Safety System 

- Provide Health and Status Data 

* Study shows good validation for the PBRA and RBA priorities established 
by the NASA IV&V IPEP process 

* Study shows good validation for the SLS NASA life cycle activity with 
accepted RIDS on Launch Vehicle (LV): 

• Launch Vehicle to SW Functional Allocations Missing 

• Safety Critical SW not identified 

• V&V Testing and Risk Criteria not complete 
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